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Assuming a particular model for "bursty" traffic at a packet-switching node, 
we find expressions for the expected delay of packets that are valid in light 
and heavy traffic. Each expression consists of a "correction factor" multiplied 
by the expected delay experienced by packets when the arrivals are "smooth" 
(Poisson) and of the same average rate. Approximate values for the correction 
factor in arbitrary traffic can be obtained by interpolation. This provides an 
example of a method that often gives fast approximate solutions for bursty 
traffic models that are not themselves tractable but become so when the 
offered traffic is assumed to be Poisson. 

I. INTRODUCTION 

Many models of queueing systems assume that arrivals occur ac- 
cording to a Poisson process. Intuitively, the Poisson process may be 
characterized by the properties that events occur one at a time and do 
not depend on the past history of events. Typically, this situation 
arises when there are large numbers of users of a system, as in the 
case of arrivals of calls to a central office, since one arrival does not 
significantly affect the probability of another. Fortunately, these 
models are often mathematically tractable. 

For other systems the Poisson assumptions are not realistic. Often 
arrivals are indicative of overall activity and give information about 
the probability of future arrivals. For example, suppose that all arrivals 
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are generated by a single user who is alternately active and inactive. 
An arrival indicates that the user is active and hence that there is a 
greater than average probability of another arrival shortly thereafter. 
A second example concerns the arrival of packets to a node in a 
packet-switching network. When virtual calls are employed, the route 
packets travel for a particular call is fixed for the duration of the call. 
If we make the assumption that an individual virtual call generates 
packets according to a Poisson process, then the instantaneous arrival 
intensity at any node is equal to the sum of the intensities for the 
calls routed through the node, which varies probabilistically with time. 
In these examples the arrivals are correlated and the traffic is said to 
be bursty. 

Even the simplest models involving bursty traffic tend to be difficult 
to solve analytically. Several authors have given approximations. 
Heffes 1 matched the first three moments of the arrival process to 
those of an Interrupted Poisson Process. Assuming that an arriving 
packet requires an exponentially distributed amount of time to be 
served, he was then able to use the results of Kuczura 2 to analyze this 
system. Laue, 3 making a similar approximation for the arrival process, 
assumed that an arriving packet requires a constant service time. The 
mean waiting time of a packet could then be calculated using the 
numerical matrix techniques developed by Neuts 4 and Lucantoni and 
Neuts. 5 A third approach developed by Anick, Mitra, and Sondhi 6 
treats a different but related model. The models of Heffes and Laue 
are based on the assumption that an individual customer generates 
packets according to a Poisson process. Anick, Mitra, and Sondhi 
assume that a customer generates packets at a constant rate for a 
random time. The resulting fluid model was treated numerically by 
calculating the eigenvalues of the resulting equations. 

All of the above works derive numerical techniques to estimate the 
traffic statistics of interest over a wide range of traffic parameters. It 
is the goal of this paper to provide simple, closed-form expressions 
that give insight into the effect of burstiness on delays. This is done 
by studying queueing systems offered bursty traffic (see Section II for 
a complete description) in light and heavy traffic. 

In light (heavy) traffic, it is obvious that the expected delay tends 
to zero (infinity). Surprisingly, when the expected delay is divided by 
the expected delay for the same system offered Poisson traffic of equal 
average intensity, the ratio goes to a nonzero finite limit in both light 
and heavy traffic. These limits may be thought of as "correction 
factors" by which the expected delay for the solvable Poisson system 
should be multiplied to obtain the expected delay for the bursty system. 
By interpolating between the light- and heavy-traffic results, one can 
obtain insight into the approximate effect of burstiness for all values 
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of traffic. Indeed, similar light- and heavy-traffic limits for the M/E k / 
c system have been used to obtain very accurate approximate values 
of the delay for all values of traffic (see Lauber and Smith 7 ). 

The remainder of this paper is organized as follows: The queueing 
model for bursty traffic and our results are discussed in detail in 
Section II. Rigorous proofs of the light-traffic results are given in 
Section III when the service times are of the phase type. (Appendix A 
presents a brief background on phase-type distributions.) Since any 
service-time distribution can be approximated arbitrarily closely by 
one of phase type, it is sufficient for practical purposes to establish 
the light-traffic results for the latter. Appendix B presents an intuitive 
approach for deriving the light-traffic results. Heavy-traffic results are 
presented in Section IV and concluding remarks in Section V. 

II. QUEUEING MODEL AND RESULTS 

The specific queueing model treated here is one in which the arrival 
process is a nonhomogeneous Poisson process whose rate equals Xm, 
where m is the state of an M/M/oo queue with birth rate a and service 
rate /3. The arrivals are offered to a single server whose successive 
services are assumed to be independent and identically distributed 
according to some general distribution with mean equal to pT 1 . Blocked 
arrivals queue up and are served on a first-in-first-out basis. 

This queueing model supports either of two (essentially identical) 
scenarios for the queueing of packets of information at a packet switch. 
In both scenarios, the switch is modeled as a single server with an 
infinite buffer for queued packets, and the service time of a packet is 
its length (in bits) divided by the line speed. In the first scenario, an 
individual virtual call generates packets according to a Poisson process 
with rate X, for an exponentially distributed length of time with mean 
(3~ x . The distribution of requests for virtual calls is Poisson with rate 
a, and the number of simultaneous virtual calls that can be supported 
by the switch is unlimited. The second scenario is similar to a fluid 
model treated by Mitra and Anick 8 and Kosten. 9 In this case an 
individual customer is in one of two states, either "active" or "inac- 
tive." It is assumed that the time in each of the states is exponentially 
distributed with rates /3 and y, respectively. While in the "active" 
state, the customer transmits packets according to a Poisson process 
with rate X. If there are N (large) such customers with Ny ~ a and 
y/3~ l ~ 0, then the number of "active" customers is distributed like 
the number of customers in the M/M/oo queue described above. 

Throughout the remainder of this paper, we will refer to the entities 
queued at the single server as packets and the entities in the M/M/oo 
system as virtual calls or calls. Our analysis will focus on the limiting 
form for the mean delay of a packet in a lightly or heavily loaded 

QUEUEING MODEL 1435 



system. The total number of packets generated during a virtual call is 
geometrically distributed with mean X/T 1 and the mean total rate of 
packet generation is X(a//3). 

There is a technical problem in the analysis for this model since the 
packet arrival rate is unbounded. Hence, consider first the system 
where the number of virtual calls is limited to N, i.e., the rate of 
arrivals of packets is X times the number of calls present in an 
M/M/N/N queueing system. The average rate of arrival of packets to 
the queue is 

Hpf 
X N = X(a/0)[1 - B(N, a/0)], (D 

where B(N, a/0) is the Erlang Blocking formula. Let D ( g ] be the 
expected delay of a packet in this system, and let Dj?' be the delay in 
an M/G/l with arrival rate \ N and the same service-time distribution. 
Our key light-traffic result (valid for phase-type service distribu- 
tions) is 

lim ^* = tf" , (2) 



«c 



where < k\ N) < oo, and 



N) 2 M [1 ~ »(£)] def 

where /T 1 = E(S), C 2 = var(S)/£(S) 2 (S is a service-time random 
variable), and <£(•) is the Laplace transform of the stationary excess 
of S. The limit (2) is proved by using a simple extension of a lemma 
established in Burman and Smith. 10 The exact value of k\ N) is difficult 
to compute; however, the limit kt as N -► oo is computable and can be 
interpreted as the light-traffic limit of the ratio of the delay (D B ) for 
the bursty system described earlier (with no limit on the number of 
virtual calls) and the delay (D M ) for the M/G/l queue with arrival 
rate X(a//3). This statement can be summarized (although not explic- 
itly proved) as 



lim^ = fe„ (4) 

x— o Dm 



where k t is given in (3). 



In the heavy-traffic case no rigorous limit is available. Nevertheless, 
diffusion analysis gives the following approximation in heavy traffic: 



D 



(N) 

— » ki N) (5) 



D M 
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where k h m is known explicitly [see eq. (40)] and 



lim *i? - 1 + * 1 d J f fc. (6) 

at— » a 1 + G 

This supports the conjecture that 

lim 5» = fc. (7) 

It should be noted that \<ki<kh, and while no proof is available, 
it is reasonable to conjecture that ki < Db/Dm < kh for all stable values 
of X. (Indeed it is conjectured that Db/D m is monotone, as suggested 
by a similar analysis for the delay in an M/G/c queue normalized by 
the delay in an M/M/c queue (see Lauber and Smith 7 ). 

At this point it is worth noting that the manner in which the traffic 
intensity p = (X/^)(a//3) approached or 1 affects the limiting value 
of Db/Dm- The previously described results are based on the variation 
of X only; one can also allow a, the rate of arrival of calls, to vary. For 
an intuitive example of the difference, note that X — ► corresponds to 
light traffic with one packet per call, while a — > corresponds to light 
traffic with a geometrically distributed (with mean X//3) number of 
packets per call. It can be shown (although it is not explicitly reported 
here) that Db/Dm is completely different in the two cases. 

We now focus our attention on the behavior of k t and k h for a fixed 
mean number of calls in the system (a//?). As a, /? —* oo, {ct/fi fixed) 
the arrival process of packets approaches a Poisson process and indeed, 
by examination of (3) and (6), k { and k h both go to 1. As a, — > 
(a//3 fixed), kh goes to oo, and k t goes 1 + 0/a. To understand these 
limits, note that in this case the number of calls remains constant for 
longer and longer periods of time and steady-state effects become 
significant. In heavy traffic, the process remains in states for which 
the packet generation rate is faster than the service rate, so that the 
delays become large. In light traffic, one may obtain the 1 + f$/a limit 
in an intuitive fashion by conditioning on the number of calls m at 
packet generation times and computing the conditional delay (using 
known expressions for delay) assuming a constant arrival rate Xm. 

In (4) and (7), the delay for the bursty system was normalized by 
the delay for the M/G/l system. If instead we choose to normalize by 
the delay for an M/M/l system with the same arrival and service rates 
(denoted by D m ), then the limits become 

,. D B C 2 - 1 a 

!S n~ = 1+ ~^~ + [1 ~ +W] (8) 

a— o Um & a 

and 
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foD M 2 a 



x-.— 



These results are interesting in that they suggest separation of the 
effects of variability of the service time (C 2 - l)/2 and the variability 
of the arrival process (the third term). 

In addition to the results for the mean delay Db, we show that the 
light-traffic limit of the distribution of the delay D, given D > 0, is 



J J [a + fie- 0{x - t) ]dH(x)dy 



lim P(D >t\D>0)= 7^ . (10) 

- + 1 -I e-*dH(x) 

p. Jo 

Again, in order for this to be rigorously stated it should be in terms of 
the limit of similar quantities for systems allowing only a finite number 
of virtual calls. 

III. DERIVATION OF THE LIGHT-TRAFFIC RESULTS 

In this section, we derive the light-traffic result stated in (4). Our 
approach is to show that as the traffic intensity goes to 0, the 
probability of having i (greater than 0) packets in the system goes to 
asymptotically as A'. The exact rate of convergence can be derived 
by a detailed study of the state equations and from there (4) follows 

trivially. 

Consider a single-server queue whose service times are of phase type 
(see Appendix A). Let the arrival process be a nonhomogeneous 
Poisson process whose rate is X times a function of the state of a 
Markov process. Then, the multidimensional process consisting of the 
number i of packets in queue, the state; of the arrival Markov process, 
and the phase k of the packet in service is itself a Markov process. A 
typical state will be denoted by (i, j, k) for i > and (0, j) for i = 0, 
where j > and fc = 1, • • • , m, the number of phases. The ergodic 
distribution will be denoted by p{ ■ , • , • ) and define 

p(i) = X p(hh k )> 

with the obvious definition for i = 0. When there is an upper bound 
on the arrival rate (as when the arrival Markov process is finite), then 
the technique used in Burman and Smith 10 to prove Theorem 3.1 
therein can be employed to prove: 
Lemma 1: There exists a constant R>0 such that 

p(i) < X'fl'. 
One may define 
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p(i,j,k) =lim \- l p(i,j, k) (11) 

\->o 

with an analogous definition for i = 0, and these limits may be 
recursively related and shown to exist by examination of the balance 
equations. (See Smith 11 and Burman and Smith 10 for examples of this 
technique.) Thus, when the arrival rates are bounded, the light-traffic 
methodology is straightforward. It is quite possible, however, that the 
resulting equations are difficult to solve. 

This is exactly the case when the arrival Markov process is an 
M/M/N/N queue (finite number of virtual calls). It is difficult to 
explicitly solve for p {N) [the limiting light-traffic normalized probabil- 
ities for this system, see (11)], although it can be shown that p iN) —* 
p as N — > oo, where p is the solution to the equations (assuming Lemma 
1) when the birth-death process is the M/M/oo queue. At the core of 
this argument (not presented here in detail) are the facts that the 
equations involving p {N) (-,j, •) for j < N are identical with those 
involving p <N+1) ( ■ , ;, ■ ) and that 

N—ao J I 

The existence of the limits [in (11)] can be shown by recursion on i 
and the fact that the limit was previously established for i = 0. Thus 
\im N ^cop (N) (=p) may be calculated by studying the system with N = 

00. 

We now turn our attention to calculating p by studying the bursty 
system with arrival rate X times the number of calls in an M/M/oo 
queue. For this system it is not hard to show that p, the steady-state 
probability satisfies 

- (jX + a + j0)p(O, j) + ap(0, j - 1) 

+ (; + 1)0 P (O, J + l) + J p (l, ;, n )E n = 0, 

(12) 

- O'X +a+jp- Tkk)p(l, j, k) + ap(l, j - 1, k) 

+ (j + l)Ml, j + 1, k) + I p(l,j, n)T nk 

n 

+ ;'A«*p(0, ;) + Uk I p(2, /, n)E„ = 0, (13) 

n 

and 

- (jX + a +J0 - T kk )p(i, j, k) + ap(i, j - 1, k) 

+ (j + l)MhJ + 1, k) + 2 Pdj, n)T nk (14) 

+ jXp(i - 1, j, k) + « A 2 p(i + 1, ;', n)E n = 0, for i > 2, 

n 
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where; > and o>-, T- ■, and E-, are the initial, transition, and exit 
rates defining the phase-type distribution of the service-time process. 
(These are discussed in greater detail in Appendix A.) We also assume 
that Lemma 1 holds. 
Next define the generating functions 

q(i,z,k) = lz j p(i,j,k), i>0, 
j 

and 

9(0, z) = lz j p(0,j). 

j 

From (12) to (14), we see that q satisfies the following equations 

-a(l - z)q(0, z) + 0(1 - z)q z (0, z) = 0, (15) 

9(1, z, .)[T - «(1 - z)I] + 9,(1, z, .)0(1 - z)I = -azq z (0, z), (16) 

and 

q(i, z, -)[T - a(\ - z)I] + q z (i, z, 0/5(1 - z)I 

= -zq z (i- 1,2, for i> 1. (17) 

Equation (15) immediately gives 

g( 0, Z ) = e-" m -'\ (18) 

The next lemma relates D B , the expected delay in this system, to 
q(l,z, ■). 
Lemma 2: 

lim X-'Db = -- 9,(1, 1, -)T- l e, 
x-»o a 

where e is the vector of ones. 

Proof: The mean number L of packets in the queue is given by 

l = i a - 1) s pd, j, k). 

i>i jjh 

By Lemma 1, 

lim \~ 2 L = E P(2, j, k) = q(2, 1, )e. 

X-*0 j,k 

From (17), we get that 

9(2,1, = -<Z 2 U, 1, -)T- X 

and by Little's Law we are done. E 

We now establish (3). The previous lemma shows that the key 
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quantity is q t (l, 1, •)■ Differentiating (16) with respect to z and 
evaluating at z = 1 gives 

aq(l, 1, .)/+ff.(l,l, •)(T-/S/)-»|(|+ 1) . (ID) 

where we used (18) to give us q(0, z). Substituting for z = 1 into (16) 
gives that 

9(1,1, .) = ^(-coT- 1 )=^^, 

where £ is the stationary distribution of the service-time process [see 
(42) and (43)]. Rearranging (19) we get 

qAh 1, •) - J *T~HPl ~ T)- 1 + | h + l\ atfl - T)" 1 

= -j 2 [afaT-Hpi - T)- 1 - (a + PMp-1 - T)" 1 ] 

= ~ [au>T~ l - /Mp7 - T)~ l ] 

= l-J (-wT- 1 ) + [jjj <o(p7 - T)~\ (20) 

Finally, from Lemma 2 and Corollary 1, we get 
lim \- l D B - -- g«(l, 1, -)T~ l e 

\—a a 

= - a - i-ZT- l e) - - ZT-HPI ~ T)~ l E 
P M p 



-**+ r** £*»**■ 





Normalizing by the expected delay in the M/G/l queue and integrating 
by parts gives us (3). □ 

We next calculate the Laplace Transform E(e~ sD \D > 0). In light 
traffic, a customer who is delayed (D > 0) will usually see only one 
customer in the system and will just wait for the service completion. 
This is made rigorous by Lemma 1. The probability that such a 
customer arrives and finds the server in phase k is given by 

Yj mp(l, m, k) 



£ mp(l, m, n) ' 
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or in terms of 9 this is 



From (21) we get that 



fr(l, 1, fe) 



(21) 



£(e- sD |D>0) = 



I 9,(1, 1, *)£*(«-") 

_ft 

X g,(l, 1, n) 

n 

qz (l,l, .)(s/-Tr x E 



(22) 



9,(1, 1, )e 

where E k (e~ ST ) is the Laplace transform of the remaining service time 
given that the current phase is k, and we have used proposition (1) 
from Appendix A. 

Evaluating the denominator first, from (20) and Corollary 1 we see 
that 

[9,(1, 1, ■), e] = fe) - (£, e) + fe) - S(BI - T)-*E 

W M \Pj M 

=(ti- + (i)f e - e ' H ' Md * 

W M \P/ ^o 

- M 2 1 . M i - g(g) 
"W/ W fi ~ ' 

where £ is the vector of ergodic probabilities for the service-time 
variable and His) = J" e~ sx dH{x) is the Laplace Transform of the 
service-time density. The numerator, after some algebraic reduction, 
becomes 

9,(1, 1, )(sl - TTB = (f) ^[(-T)-HsI - T)' l )E 

^ M w(/S/ - T)~ l E - «(sl - p-'E 



s-/3 

'«y i - g (s) M gXjg) - g(f) 



Combining the two calculations, we get 



1 - H(s) 



+ 



s-0 



[it(P) - H(s)} 



E(e- u \D>0) = 



(23) 



«-+ 1 -i?(0) 



It is not difficult to show that (23) is the transform of (10). 
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IV. DERIVATION OF THE HEAVY-TRAFFIC RESULTS 

In this section we describe the technique that allows us to arrive at 
(5) and (6). This approximation is derived by first proving that the 
number of packets in the system, when appropriately scaled, converges 
to a diffusion process X(t) as p {N) converges to one. Given the drift 
and infinitesimal variance of the diffusion process, one can obtain the 
steady-state mean of X(t), and by using Little's Theorem, we get the 
approximation given in (5). 

The main theorem of this section, which can be proved rigorously 
using the techniques in Burman, 12 forms the theoretical basis for (6). 
We will outline its proof and show in detail how to calculate the mean 
and variance of the resulting diffusion, which from an application 
point of view is the difficult part of developing these approximations. 

Consider a sequence of processes X n (t), where the nth process 
represents the number of packets at time t in a single-server system 
to which packets arrive at an instantaneous rate A„ times the state of 
an M/M/N/N queueing system (representing the number of virtual 
calls). The heavy-traffic limits are found by defining X„ as follows: 

\ n E^V = n-^=, (24) 

where 8 is a positive constant and E lN) V is the expected number of 
calls in the M/M/N/N system. We are initially interested in studying 
the sequence of scaled processes rC l/2 X n {nt) as n — * oo. 

We start by investigating the limiting behavior of the infinitesimal 
generators of a sequence of Markov processes created by appending 
supplementary variables to X n (t). A limiting generator is identified 
and the Trotter-Kato Theorem (see Kato 13 ) implies that the finite- 
dimensional distributions converge. The form of the limiting generator 
completely determines the limiting process. Weak convergence can be 
established via a theorem of Stroock and Varadhan. 14 

Let V(t) be the number of virtual calls at time t and let Y{t) be the 
time since the packet currently in service entered service. The multi- 
dimensional process 

M n (t) = [n- 1/2 X n (nt), Y(nt), V(nt)] 

is Markov. We denote a typical element of the state-space as (x, y,j), 
where x = 0, n~ 1/2 , 2n' 1/2 , . . . , y S [0, oo) and; = |0, 1, • • • , N\. For 
the remainder of this paper, let h(y) be the density of the service-time 
distribution, 

my)- I Hs)ds, My) = |g 
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and assume that for some constants 7 and T, 
0<7 <n(y) < T<oo. 



(25) 



The implications of and conditions for relaxing (25) are discussed in 
Burman. 12 These conditions are required for the method of proof and 
do not pose any significant restrictions on the results. 

Let B and Q be the infinitesimal generators of the processes V{t) 
and Y(t), respectively. The generator B is an (N + 1) X (N + 1) matrix 
given by 



B = 



—a a 

-03 + a) 

W 



a 

-(2/? + a) 



and Q is a first-order linear differential operator given by 

Qf(y)=f'(y) + n(y)[W)-f(y)l 

The following two lemmas are needed to carry out the calculations 
needed in the main theorem of the section (to be stated below): 

Lemma 3: The equation 

Bv = w (26) 

has a solution v if and only if 

(e, w) = 0, (27) 

where e* = l/k\(a/0) k = l/k\ p k . In this case u is unique to an additive 
constant and is given by 



fi ' 



v(k + 1) = v(0) + - £ L j t T Mi)- 

a ;=o P J i-0 I- 



(28) 



Proof: Since B is a finite-dimensional linear operator corresponding 
to an ergodic Markov process, it has a one-dimensional null space 
spanned by the vector c. Hence, (27) is both necessary and sufficient 
for a unique solution of (26) to exist. This solution is easily seen to be 
given by (28). 
Lemma 4: The equation 



□ 



Qf = 8 



has a solution f if and only if 



I 

•Jo 



g(y)H c {y)dy = 0. 



(29) 



(30) 
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In this case, f is unique to an additive constant and is given by 



fly) 



-— f 



H c (s)g(s)ds. 



(31) 



Proof: The operator Q is the generator of an ergodic Markov process 
with the stationary density tiH c (y). A unique solution exists if and 
only if (30) holds. Solving the first-order linear differential equation 
gives (31). □ 

We are now ready to state the main theorem of this section: 
Theorem 1: Under assumption (25), 

n- 1/2 X n (nt)^X(t), 

where X(t) is a diffusion on R + with pure reflection at the origin, 
downward drift 8 and infinitesimal variance s 2 given by 

121 



s 2 = l\\E iN) V + n 3 a 2 + I 4r 



k-i 



where 



p - 1 r 



k=o curt, j=o 






1 PAn-J) 



(32) 



is the steady-state probability of finding k calls in the M/M/N/N 
blocking system. 

Proof of Theorem: As mentioned earlier, we will show how to identify 
the mean and variance of (32). The infinitesimal generator for M n (t) 
is given by 



Anftx, y, j) = n(B + Q)f + Xj 



f\x + -7=,y,j) -f(x,y,j) 



+ n(y) 



f\x--j=,Q,j) -f(x,0,j) 



for x > -j=, (33) 

vn 



and 



A„/(0, 0, ;) = nBf + Xj 



f\^0,j)-f(0,0,j) 



(34) 



For/(x) twice continuously differentiable with /'(0) = 0, set 



Ux, y, j) = f(x) + 4= f'(x)g(y, j) + - f"(x)h{y, j). (35) 
vn n 

We construct bounded functions g and h so that 

A n f n ^Af 
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uniformly, where 

Af(x) = mf'(x)+s 2 r(x). 

The constants m and s 2 are determined in the process. Given (25), 
these constructions will complete the proof (see Burman 12 ). 
From (35) and (33) we see that 

A n f n = n(B + Q)f + yfof'(x)[\ n j ~ niy) + (B + Q)g] 

+ /"(*) \\ [W + My)] + KMy, i) - /*(y)*(o, j) 

+ (B + Q)h{yJ)i + 0\j=). (36) 

First note that since / is independent of y and;', (B + Q)f = 0. Set g 
equal to the solution of the equation 

(B + Q)g = -[Kj ~ KE {N) V - n(y) + »]. (37) 

Lemmas 3 and 4 imply that g exists and 

c (y)^o (38) 

- - 1 * Z T [/' - ^ 

Let Ji be the solution of the equation 

(Q + B)h = -[w(y, j) - s 2 ], (39) 

where w(y,j) = 1/2[\J + niy)] + \Jg(yJ) ~ n(y)g(0J)- The constant 
s 2 [see (26)] can be easily calculated from conditions (27) and (30), 
i.e., 



* ( ^ ) = tffef ,/! ,| ' 1, ' l ^'' cfc 



N i f ° 

A A Jo 



H c (y)w(y, i)dy = 0. 
Using g and /i calculated above we have 

A n f n = -5f'(x) + S 2 f»(x) + f-U. 

When x = analogous calculations give that A„/„ converges provided 
/'(0) = 0, and the proof is complete. □ 

The limit theorem for the M/G/l queue with arrival rate \ n E {N) V 
(see Iglehart and Whitt 15 ) gives the same mean 8 with the variance 
XE {N) V + n 3 fi 2 for the limiting diffusion. Calculating the steady-state 
expected number in the limiting systems and using Little's Theorem 
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(see Cooper 16 ) yields the asymptotic expression for the ratio of D B N) 
and Dm\ the delays in the two systems: 



AN) 



N-l i 

I 4r 



U B , , n *-0 J^k Li=0 



* 



I PAn - \i) 



n (N) ~ x T *" 3 



(40) 



Letting N go to infinity, P* goes to the Poisson distribution and (40) 
goes to 

1 + 2n/a 



1 + c- 



as promised. □ 

Remark: We are careful here not to write (40) as a limit but as an 
approximation. In order to strictly prove convergence in (40), two 
rather technical steps remain to be proved. The first is that the steady- 
state number in the queue (when scaled) converges to the steady-state 
value of the diffusion. The second is that the expected values of these 
steady states converge. Both are difficult issues in themselves and, 
aside from mathematical completeness, add little information to the 
approximation, which is the germaine issue of this paper. 

V. CONCLUDING REMARKS 

We considered here a single-server queueing system with a nonho- 
mogeneous Poisson arrival process whose rate is some constant X 
times the state of an independent M/M/oo system. In this paper, we 
derived limiting values for the mean delays as the traffic intensity 
goes to zero and to one. 

This system was used to model the delay of packets at a packet 
switch. In this setting, an individual data customer generates packets 
at a constant rate X and the number of customers generating packets 
is given by the state of the M/M/oo system. This is, of course, not the 
only possible model for packet arrivals. Packets generated by an 
individual virtual call may be "smoother" or more "bursty" than 
packets generated by a Poisson process. It is also possible that restric- 
tions could be imposed on the total number of simultaneous virtual 
calls, thereby making the infinite-server assumption unrealistic. Work 
is currently under way to extend the techniques of this paper to cover 
these and other more general models of bursty traffic. 

Our ultimate goal in studying Db/Dm in both light and heavy traffic 
is to be able to derive simple, closed-form approximations for Db for 
all values of the traffic intensity p. One candidate approximation is to 
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linearly interpolate between the values obtained for D B /B M when p -»• 
and when p -► 1 [see (4) and (5)]. This approach gives the following 
estimate for the mean delay: 



p (1 + C 2 ) 
Db ~ 1 - P 2p 



M 1 - (1 - p)0(/3) 



a (1 + C 2 ) 



More sophisticated interpolations are possible (see Lauber and Smith 7 
for applications of these techniques to estimating the delays in an 
M/G/c queue); however, in the absence of any test data, verification 
is difficult. One method of verification is to study the accuracy of these 
approximation techniques when applied to other models of bursty 
arrivals for which explicit expressions are known (see Yechiali and 
Naor 17 ). This work is currently under way and will be reported on in 
the future. 
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APPENDIX A 

Background on Phase-Type Distributions 

Appendix A summarizes results for phase-type distributions that 
are used in Section III. A service time is said to have phase-type 
distribution if it is distributed like the first exit time from a continu- 
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ous-time, finite-state Markov chain. Any distribution can be arbitrar- 
ily approximated in the sense of weak convergence by one of phase 
type. We assume that the states (also known as phases) are the 
nonnegative integers i, i = 1, • • • , m. Let the rate of transition from 
phase i to phase j be Ty (i ¥= j), and the rate of exiting from phase i 
be £,-. Define T„ = — £,>,- T tj — E„ i.e., minus the rate of leaving state 
i. We assume that T, the matrix of T$, is invertible; this is sufficient 
to imply that the real part of the spectrum of T is strictly negative. A 
customer starts service in phase i with probability «,-. Following Neuts, 4 
we use the notation (o>, T) to describe this distribution, where a> is the 
vector of initial probabilities and T is the m-dimensional matrix of 
rates. 

The vector £ of ergodic probabilities for the service phase of the 
renewal process is determined by normalizing the solution to the 
equations 

-6T« = I Mi + (2£E,R (41) 

or in matrix notation, 

*T--(fcE)«. (42) 

The service rate n is defined as 

H = (£, E). (43) 

It is not difficult to show that n is the reciprocal of the mean service 
time. 

Let t be the first exit time from the chain; let M,(s) = Ei(e~ 8T ), the 
Laplace Transform of t given the initial state is i; and M" = _E,t". The 
results of Proposition 1 are well known (see Kielson, 18 page 82, and 
Burman and Smith 12 ). 
Proposition 1. For r, M(s), and n n defined above, 

M(s) = (sI-T)- 1 E (44) 

and 

M n = nl(-l) n T- a e, (45) 

where e is the vector of all ones. In particular, the nth moment of the 
service-time distribution (M") is 

M n = n\(-l) n UT- n e). (46) 

If H c (x) equals the tail of the service-time distribution, then the 
following corollary is immediate. 

Corollary 1. 
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-ZT- l e= I xnH c (x)dx = ^, (47) 

and 

-ST-HPI - Ty'E = J e~ Pz J fiH c (s)dsdx. (48) 

Proo/: To see (47), observe that nH c (x) is the density of the remaining 
service time when the process is sampled in equilibrium, and apply 
Proposition 1. The identity on the integral can be obtained by inte- 
gration by parts. In a similar fashion, 



gr l (T - piy'E = 



fl(T - 0I)' 1 - T -1 ]E 

p 



J f iH c (x)dx - J e- px nH c {x)dx 



and integration by parts gives us (48). □ 

APPENDIX B 

Intuitive Derivation of the Results in Light Traffic 

The following argument is based on the intuitive notion that, in 
light traffic, almost all arriving packets arrive to an empty system and 
are served before the arrival of another packet. Furthermore, the times 
when there is exactly one packet in the system constitute almost all 
of the time in which an arriving packet might be subject to delay. 
Thus, in light traffic, it is easy to derive the proportion of time in 
which an arrival will be delayed, and to find the delay for such an 
arrival. A slight complication is introduced in the analysis by the fact 
that the arrival rate of packets is not constant, but this is easily 
overcome. 

While the overall derivation is not rigorous, it is convincing and 
gives insight into the light-traffic behavior. The results, of course, are 
consistent with the rigorous results derived for phase-type distribu- 
tions in Section III. 

We will begin with traffic-independent results for the model de- 
scribed previously in the beginning of Section II, in which the instan- 
taneous arrival rate equals X times the state of an M/M/oo queue with 
birth rate a and service rate equal to p. The equilibrium distribution 
of the M/M/oo queue governing the arrival process is easily seen to be 
Poisson with mean a/0. However, this is not its distribution immedi- 
ately after an arrival, since the rate of arrivals is proportional to the 
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state of the M/M/oo queue. Thus, the conditional probability that the 
state of the M/M/oo queue is m (for m > 1) immediately after an 
arrival is 



lk(am>±e-°» (m " 1)! 

This may be thought of as the distribution of a Poisson random 
variable with mean (a//?) with support right-shifted one unit. This 
point of view is useful in computing the distribution of the state of 
the M/M/oo queue t time units after an arrival of a packet (denoted 
N t ) t since the Poisson distribution is stationary, and the additional 
unit is still present with probability e~ pt . Thus, 

E(z Nl ) = e (amz - 1] [l + e~ 0t (z - 1)]. (49) 

Now consider the system in light traffic. Denote the state of the 
system by (N, M, T) where N is the number of packets in the system, 
M is the state of the M/M/oo queue that modulates the arrival process, 
and T is the remaining service time of the packet being served. 

We first obtain an expression for E(e~" T z M 8iN) in light traffic, where 
di N = for N # 1 and 5 U — 1. We then show how to use this quantity 
to obtain the desired limits. In light traffic, almost every packet arrives 
to an empty system and is served before another arrival. By Little's 
Law 

P(N = 1) = E8 1N ~ \aE(S)/(3. 

Again, making the assumption of the last sentence and looking at the 
system at only those times for which N = 1, we obtain by standard 
renewal theory arguments that 

•a 



Eie-'VN = 1) = ^ E J o E{z Nt )e- g(S - l) dt 



">••>• 



Multiplying, we obtain that 

E(e- gT z M 6 1N ) ~ \(a/(3)G(z,8). (50) 

By conditioning on S and using (49), we obtain 

G(z, s) = gW«<*-« - s |[1 - H{s)] + fcj^j [H(s) - #(0)J, (51) 

where H is the Laplace Transform of a service time. 

Equations (50) and (51) can be used to find desired properties of 
the queue in light traffic. For example, since nearly all packets that 
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are delayed are generated when there is only one other packet in the 
system, and since the rate of generation of packets is X times the 
number of calls, we find the rate of generation of delayed packets, X D , 
is 

X D - WaffiQJX, 0), (52) 

or 

x D ~ x 2 -L//3) 2 i + am - mm. w) 

The Laplace Transform of the delay, given that the delay is greater 
than 0, defined to be <f>(s), is also found easily since the delay of a 
packet equals the remaining service time on arrival. Thus, 

., . G«(l, 8) 

or 

a/8[l - H(s)] + j4- [H(s) - H(P)] 

* S) a /, + l"- S HW) * (54) 

Inversion of the Laplace Transform gives (10) and also gives 

E(D\D>0)~ a/ » +1 _ m . (55) 

where n* = E{S 2 ). Of course, P(D > 0) = — -^r so that (52) and (54) 
give 

W» - J {a + i-Jn -«»]}. (56) 

This may be combined with the Pollaczek-Khintchine formula to give 
(3). 

AUTHORS 

Donald R. Smith, A.B. (Physics), 1969, Cornell University; M.S. (Operations 
Research), 1974, Columbia University; Ph.D. (Operations Research), 1975, 
University of California, Berkeley; Bell Laboratories, 1980—. Before joining 
Bell Laboratories, Mr. Smith was employed at Adaptive Technology, Inc. from 
1970 to 1974, and was Assistant Professor in the Department of Industrial 
Engineering and Operations Research, Columbia University from 1975 to 
1979. At Adaptive Technology, Mr. Smith developed mathematical models for 

1452 THE BELL SYSTEM TECHNICAL JOURNAL, JULY-AUGUST 1983 



new techniques in statistical multiplexing. At Bell Laboratories he is in the 
Operations Research Department of the Network Analysis Center pursuing 
interests in applied stochastic processes. 

David Y. Burman, B.S. (Mathematics), 1968, C.C.N.Y.; Ph.D. (Applied 
Mathematics), 1979, New York University; Bell Laboratories, 1969—. At Bell 
Laboratories, Mr. Burman has worked on problems in network flows, sched- 
uling, and stochastic processes. 



QUEUEINC MODEL 1453 



